Job 293 van 1000



Match jouw profiel Solliciteren



Data Engineer


Data EngineerResponsible for ensuring high-quality access to and management of data sources, guaranteeing data quality through cataloging, normalization, and qualification to support analytics teams. Collaborates on defining data governance policies and structuring the data lifecycle in compliance with regulations. Oversees data integration and supervision from various application systems and Big Data/IoT platforms, ensuring data quality in the Data Lake through validation and duplicate removal.Key responsibilitiesEnsure high-quality access to data sourcesMaster and maintain data quality through cataloging, normalization, and qualification to facilitate use by analytics teamsCapture, integrate, and consolidate structured and unstructured data from diverse systems into the Data LakeStructure, MAP, clean (duplicate removal), and validate data setsCollaborate on establishing data governance policies and managing the data lifecycle in compliance with regulationsOversee and monitor data pipelines on Big Data and IoT platformsSkills and competencesAgile methodologyMulti-taskingAnalytical thinkingOrganizational skillsQualificationsAt least 5 years of experience with Agile methodologyAt least 5 years of experience in Big Data architecture and technologiesAt least 5 years of experience with PythonAt least 5 years of experience with SQLAt least 5 years of experience developing and consuming APIsAt least 3 years of experience working on multiple topics simultaneouslyAt least 3 years of experience in analytical and synthesis workAt least 3 years of experience demonstrating organizational rigorAt least 3 years of experience with SparkAt least 3 years of experience with AWSAt least 3 years of experience with DatabricksAt least 3 years of experience with Shell scripting

Match jouw profiel Solliciteren

Meer banen van je zoekopdracht